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Abstract 

A  closed-loop  controller  for  hypnosis  was 
designed  and  validated  on  humans  at  our 
laboratory.  The  controller  aims  at  regulat¬ 
ing  the  Bispectral  Index  (BIS)  -  a  surro¬ 
gate  measure  of  hypnosis  derived  from  the 
electroencephalogram  of  the  patient  -  with 
the  volatile  anesthetic  isoflurane  administered 
with  a  closed-circuit  breathing  system.  The 
control  algorithm  consists  of  a  cascaded  Inter¬ 
nal  Model  Controller  (IMC)  where  the  master 
loop  aims  at  regulating  BIS.  The  slave  loop 
tracks  endtidal  concentration  references  pro¬ 
vided  by  the  master  controller.  In  this  paper, 
a  new  tuning  method  is  presented.  First,  a  ro¬ 
bust  design  procedure  which  guarantees  sta¬ 
bility  of  the  slave  controller  despite  paramet¬ 
ric  uncertainties  is  described.  Then,  we  will 
demonstrate  how  the  estimation  of  the  drug’s 
equilibration  constant  ke o  greatly  improves 
performance  if  the  estimated  value  is  used  to 
update  the  models  in  the  control  scheme.  In 
order  to  do  so,  an  identification  scheme  for  ke o 
is  proposed,  which  requires  estimation  of  the 
drug’s  time  to  peak  effect  fpeafc.  The  identifica¬ 
tion  algorithm  requires  few  modeling  assump¬ 
tions  and  guarantees  convergence.  Simulation 
results  are  presented,  which  quantify  both  the 
performance  of  the  identification  scheme  and 
the  improvement  of  the  closed-loop  control 
performance. 

Keywords  :  Closed-Loop  Control,  Internal 
Model  Control  (IMC),  Hypnosis,  Isoflurane, 
Identification. 


1  Introduction 

Closed-loop  control  in  anesthesia  is  receiving  in¬ 
creasing  attention  both  from  a  research  and  a  clinical 
perspective  [3,  2] .  A  necessary  condition  for  the  feasi¬ 
bility  of  a  closed-loop  drug  administration  scheme  is 
the  availability  of  a  measurement  for  the  clinical  end¬ 


point  to  be  targeted.  Bispectral  Index  (BIS)  mon¬ 
itors  provide  anesthesiologists  with  an  ideal  target 
for  the  administration  of  hypnotic  drugs  and  enable 
closed-loop  hypnotic  administration  [6]. 

In  general,  large  model  variability  severely  limits 
the  controller’s  performance.  In  order  to  guarantee 
stable  controller  behaviour  for  the  whole  population 
of  patients,  closed-loop  controllers  must  often  be  ‘de¬ 
tuned’.  That  is,  they  are  tailored  to  the  worst  case 
situation  and  consequently  tend  to  be  sluggish  for 
the  average  subject  in  the  population.  A  possible 
way  to  improve  performance  consists  in  estimating 
the  particular  subject’s  characteristics  during  anes¬ 
thesia.  However,  on-line  adaptation  is  limited  by  re¬ 
stricted  bandwidth  on  the  inputs  to  be  applied  and 
ethical  constraints. 

We  developed  a  method  for  controller  design  that 
combines  robust  and  adaptive  controller  tuning.  The 
design  procedure  was  applied  to  an  existing  cascaded 
Internal  Model  Controller  (IMC)  which  regulates  BIS 
with  isoflurane.  A  robust  design  method  is  used  to 
adjust  the  aggressiveness  of  the  slave  controller  to 
cope  with  uncertainties  in  the  actuator  and  in  the 
pharmacokinetic  (PK)  model.  In  the  pharmacody¬ 
namic  (PD)  model,  an  identification  algorithm  which 
uses  the  data  gathered  during  the  initial  uptake  of 
the  volatile  agent  is  used  to  adapt  to  the  specific  pa¬ 
tient’s  characteristics.  The  proposed  scheme  allows 
us  to  identify  the  equilibration  constant  of  isoflurane 
without  special  or  additional  administration  of  anes¬ 
thetic. 

After  a  brief  outline  of  the  cascaded  IMC  controller, 
the  mathematical  background  of  the  identification 
procedure  is  discussed.  Simulation  examples  are  re¬ 
ported,  which  quantify  the  accuracy  of  the  estima¬ 
tion  algorithm.  Then,  tuning  of  the  slave  and  master 
controller  on  the  basis  of  the  identified  equilibration 
constant  are  presented.  Simulations  of  the  closed- 
loop  controller  response  are  shown,  which  demon¬ 
strate  performance  improvements. 
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embedded  directly  into  the  controller  scheme  by  up- 
*  px  — J  k  L*  dating  the  corresponding  parameters  in  the  parallel 

models.  This  last  aspect  is  exploited  in  the  proposed 
-  adaptive  design  procedure. 


Figure  1 :  Block  diagram  of  the  cascaded  Internal  Model 
Control  (IMC)  to  regulate  BIS. 


2  BIS  Controller 


A.  Controller  Setup 

In  this  section  the  principles  of  the  closed-loop  con¬ 
troller  are  presented.  Figure  1  depicts  the  block  dia¬ 
gram  of  the  cascade  closed-loop  controller  to  regulate 
BIS  [4],  Ct.  and  Ct,ref  denote  endtidal  concentra¬ 
tion  measurements  and  references  measured  as  vol¬ 
ume  percentages.  The  input  of  the  control  system  u 
is  the  isoflurane  concentration  in  the  fresh  gas  mix¬ 
ture  entering  the  breathing  system,  u  is  constrained 
between  0%  and  5%  and  will  be  denoted  as  ‘vaporizer 
setting’  from  here  on.  The  slave  controller  Q2  tracks 
endtidal  concentration  references  values  Ctjrey  pro¬ 
vided  by  the  master  controller.  The  saturation  af¬ 
ter  Q i  constrains  endtidal  concentration  references 
between  a  lower  and  an  upper  limit  specified  by  the 
anesthesiologist.  This  is  done  to  guarantee  minimum 
delivery  of  hypnotics  and  to  prevent  overdosing,  re¬ 
spectively.  In  Fig.  1,  P2  and  P2  represent  the  trans¬ 
fer  functions  from  the  vaporizer  setting  u  to  endtidal 
concentration  Ct  in  the  patient  and  in  the  parallel 
IMC  model,  respectively.  The  models  combine  the 
dynamic  description  of  the  closed-circuit  breathing 
system  with  the  PK  model  of  isoflurane. 

Pi  and  Pi  in  Fig.l  represent  the  dynamic  model 
which  links  endtidal  concentration  Ct  to  effect  site 
concentrations  Ce  [%} .  Precisely,  we  adopted  the  fol¬ 
lowing  first  order  model: 

rIC 

^  =  ke0(Ct  -  Ce)  (1) 

at 


where  ke o  is  the  equilibration  constant  at  the  effect 
site.  Q2  and  Q i  were  chosen  as  the  filtered  inverses  of 
the  nominal  plants  [5].  The  IMC  filters  were  chosen 
as: 


Fi(s) 


1 

(Ai  s  +  l)ni 


(2) 


with  n2  =  3  and  ni  =  2  to  guarantee  strict  proper¬ 
ness  of  the  controllers.  Ai  and  A2  affect  the  speed  of 
the  master  and  slave  controller,  respectively.  More 
precisely,  for  a  single  linear  IMC  control  system  with 
P  =  P,  the  closed-loop  transfer  function  from  refer¬ 
ence  to  output  values  is  P(s)  [5]. 

Among  others,  one  particular  advantage  of  the  pro¬ 
posed  IMC  strategy  was  exploited  in  the  tuning  pro¬ 
cedure  presented  here.  Namely,  every  additional  in- 


B.  Motivating  Example 

To  guarantee  controller  stability  in  spite  of  model 
uncertainty,  the  tuning  parameters  Ai  and  A2  were 
set  to  relatively  high  values  during  initial  clinical 
studies.  This  in  turn  decreased  the  controller’s  per¬ 
formance  for  the  average  subject  in  our  models.  Fig¬ 
ure  2  illustrates  an  oscillating  closed-loop  step  re¬ 
sponse  with  Ai  and  A2  set  to  0.6  [min]  and  0.4  [min], 
respectively.  In  the  depicted  simulation,  paramet¬ 
ric  uncertainties  were  considered  in  the  slave  con¬ 
trol  loop.  As  for  the  master  control  loop,  we  chose 
ke o  >  ke q.  The  simulation  example  suggests  that  in 


Figure  2:  Simulated  closed-loop  step  response  with 
model  uncertainty  in  the  slave  model.  For 
simulation  purposes  we  set  ke o  =  1  [min-1] 
and  fee o  =0.385  [min-1]  in  the  master  loop. 


order  to  not  only  improve  control  performance  but 
also  guarantee  acceptable  controller  behaviour,  rel¬ 
evant  patient  characteristics  must  be  identified  and 
used  during  controller  tuning.  Among  the  relevant 
parameters  to  be  identified,  the  drug  equilibration 
constant  ke o  plays  a  key  role.  Parametric  uncertain¬ 
ties  in  the  slave  model  on  the  other  hand,  have  little 
impact  on  controller  behaviour,  since  the  parame¬ 
ters  having  the  most  significant  effect  on  the  per¬ 
formance  of  the  slave  controller  are  the  parameters 
of  the  breathing  system.  These  are  modified  by  the 
anesthesiologist  during  surgery  and  are  periodically 
used  to  update  the  paralell  model  in  the  slave  loop. 


3  Mathematical  Background 

The  identification  algorithm  requires  knowledge 
of  the  time  to  peak  effect  tpeak  in  the  BIS  profile 
following  a  square  input  of  isoflurane.  Due  to  the 
noise  characteristics  of  the  BIS  signal,  tpeak  must 
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sequence.  The  calculated  tpeak  is  then  used  to 
compute  the  equilibration  constant  ke q. 


A.  Estimation  Algorithm 

The  PD  model  relating  the  effect  site  concentra¬ 
tion  Ce  to  BIS  is  monotone  decreasing.  Therefore 
the  time  to  peak  tpeak  of  the  resulting  BIS  profile 
corresponds  to  the  time  to  peak  of  the  effect  site 
concentration.  From  (1)  we  deduce  that  Ct(tpeak)  = 
Ce{tPeak )  where  Ct  [%]  denotes  endtidal  concentra¬ 
tion  measurements.  In  the  literature  [7]  the  function 

F(t,  ke 0)  =  Ct(t)  -  Ce(t,  ke 0)  (3) 

was  considered,  for  which  the  patient’s  equilibration 
constant  k*0  is  such  that  F{tpeak ,  k*0)  =  0. 

To  solve  (3)  for  fc*0  a  bisection  method  was  proposed 
[7].  However,  since  the  endtidal  concentration  mea¬ 
surements  do  not  depend  on  effect  site  concentra¬ 
tions,  we  have: 


dF 

dk~ 


\t=t„eak  — 


eO 


8Ce 

dk, 


.  <  0  V  ke  o  <  k, 


eO 


eO- 


(4) 


To  verify  the  last  inequality,  note  that  from  (1),  the 
locus  Ct(t)  can  be  regarded  as  the  envelope  of  the 
maxima  of  Ce(t)  for  different  values  of  ke q.  This 
implies  that,  below  Ct{t),  Ce(t)  is  monotone  increas¬ 
ing.  In  particular,  the  effect  site  concentration  grows 
faster  for  higher  equilibration  constants  ke o-  Equa¬ 
tion  (4)  allows  us  to  use  the  Newton  algorithm  to 
find  the  solution  k*0  .  The  algorithm  is  iterative  and 
guarantees  convergence  to  the  solution  at  a  quadratic 
rate  [1],  According  to  (4)  the  initial  guess  to  start 
the  iteration  must  be  smaller  than  the  solution  fc*0 
(e.g.  o  =  0).  We  have: 


-F(O)  =  Cp  {tpeak) 


ufc+ 1 
VO 


—  _ 
^  Ke0 


F(kke o) 


(5) 

(6) 


F'(kke 0) 

In  the  preceding  equations  the  notation  was  simpli¬ 
fied  in  the  sense  that  F(keo )  stands  for  F(ke o,  tpeak), 
as  it  will  be  assumed  from  now  on.  Endtidal  concen¬ 
trations  and  BIS  are  obtained  at  a  sampling  time  of 
A T=  5  [s].  The  discrete  equivalent  of  (1)  is: 

Ce(k+ 1)  =  e~ke°AT  Ce{k)  +  (1  —  e~ke°AT)Ct(k)  (7) 


Figure  3:  Estimation  accuracy  of  the  ke o  identification 
algorithm.  Each  boxplot  depicts  the  sum¬ 
mary  statistics  of  100  simulations  which  were 
performed  for  every  ke o-  We  assumed  that 
BIS  measurements  were  corrupted  by  zero 
mean  gaussian  noise  with  variance  a  bis-  We 
adopted  cjbis  =  4  and  a  bis  =  2.6  in  the  left 
and  right  plot,  respectively. 


real  ke o  and  of  the  measurement  noise  in  BIS.  In 
each  plot,  100  simulations  were  performed  for  ev¬ 
ery  keo,  assuming  that  BIS  measurements  are  cor¬ 
rupted  by  gaussian  noise.  We  excluded  equilibration 
constants  such  that  ke o  >  l[min_1],  since  there  is 
no  discernible  difference  in  behaviour  amongst  such 
patients.  During  the  simulation,  the  vaporizer  set¬ 
ting  was  set  to  5%  until  BIS  measurements  reached 
50.  Subsequently,  the  vaporizer  was  set  to  0%  un¬ 
til  a  minimum  was  recognizable  from  the  data  series. 
Then  automatic  control  was  switched  on  to  maintain 
a  reference  BIS  of  50.  The  variance  ake0  of  ke o  in¬ 
creases  with  ke o,  as  can  be  seen  by  the  boxplots  in 
Fig.  3.  This  trend  can  be  explained  when  consider¬ 
ing  the  time  profile  of  both  endtidal  concentrations 
and  BIS  values.  In  fact,  for  increasing  ke o,  tpeak 
converges  to  the  time  to  peak  of  the  endtidal  con¬ 
centration  profile.  In  these  cases  we  cannot  provide 
an  accurate  estimate  ke o  from  the  tpeak  information. 
However,  for  cases  with  keo  <  l[min_1],  when  con¬ 
sidering  the  coefficient  of  variation  CV  =  cr//x,  the 
estimation  accuracy  is  approximately  CV  =  0.03  and 
CV  =  0.02  for  <jbis  =  4  and  cjbis  =  2.6  as  measure¬ 
ment  noises,  respectively. 


4  Controller  Tuning 


where  k  denotes  the  generic  sampling  time.  Assum¬ 
ing  that  the  sampling  time  npeak  at  which  the  BIS 
peak  occurs  is  known,  ke o  can  be  computed  using  the 
iterative  method  in  (6). 

B.  Estimation  Accuracy 

Figure  3  depicts  the  accuracy  of  the  identification 
algorithm  for  the  estimated  ke o  as  a  function  of  the 


This  section  will  highlight  the  two  fundamen¬ 
tally  different  approaches  for  controller  tuning  in  the 
slave-  and  the  master-loop. 

A  robust  tuning  procedure  was  applied  to  the  slave 
loop,  where  a  sufficient  condition  for  stability  is 

\F2(jco)\<T^—  (8) 
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represents  an  upper  bound  for  the  multiplicative 
uncertainty  [5].  We  considered  variations  in  both 
PK  and  closed-circuit  respiratory  system  parameters 
such  that  85%  of  the  statistical  variation  around 
their  nominal  value  is  captured.  This  allows  us  to 
use  A2  =0.1  [min]  as  a  lower  boundary.  In  the  final 
implementation  we  used  a  A2  =  0.4  in  order  to  gain 
a  safety  margin  towards  general  model  uncertainty. 

Analogously  to  (8)  for  the  slave  controller,  plant- 
model  mismatches  also  limit  the  aggressiveness  of 
the  master  controller  by  imposing  a  lower  bound  on 
Ai.  However,  the  dynamics  of  the  parallel  model  in 
the  master  controller  are  exclusively  determined  by 
ke o-  Consequently,  if  the  estimated  ke 0  is  used  to 
update  the  model  in  the  master  controller,  we  are 
allowed  to  decrease  Ai  by  virtue  of  a  reduced  model 
uncertainty. 

Since  there  is  no  established  analytical  way  to 
analyze  a  cascaded  IMC  controller  with  model 
uncertainties  and  non-linear  elements,  we  had  to 
rely  on  comprehensive  simulation  to  find  optimal 
settings  for  the  filter  parameter  Ai.  The  simulations 
performed  revealed  that  a  Aj  =  0.6  [min]  suits  our 
specifications  best. 


5  Controller  Performance 

The  modifications  discussed  in  the  previous  sec¬ 
tion  guarantee  robust  control  as  well  as  fast  settling 
times  even  for  large  model  uncertainties,  as  depicted 
in  Fig.  4,  where  the  modified  controller  is  applied 
to  the  worst  case  scenario  introduced  beforehand  in 
Fig.  2.  Even  though  the  sufficient  conditions  for  ro¬ 
bustness  allow  us  deviations  in  the  average  subject 
parameters  up  to  1.55cr,  extensive  simulations  have 
shown  stable  behaviour  for  parametric  uncertainties 
up  to  2cr,  which  corresponds  to  more  than  95%  of 
the  statistical  spread  of  parameters.  Unfortunately, 


Figure  4:  Step  response  for  a  model  uncer¬ 
tainty  of  2 obis  with  ke 0  =  1  [min^1]  and 
ke  0  =  1.3[min_1] 


gorithm  in  a  clinical  environment  and  are  therefore 
restricted  to  simulation  results. 


6  Conclusion 

In  this  paper  we  presented  an  approach  which  aims 
at  improving  controller  performance  in  spite  of  large 
model  uncertainties. 

Apart  from  the  improved  control  performance,  we 
showed  that  the  influence  of  uncertainties  in  other 
PK  parameters  becomes  negligible  once  the  patient’s 
ke 0  is  embedded  in  the  model  used  for  control. 

Our  tuning  approach  has  decreased  average  settling 
times  by  35%  without  generating  large  overshoots. 
From  the  results  presented  in  the  paper,  one  may 
venture  to  conclude  that  the  identification  of  the 
patient’s  characteristics  is  imperative  to  guarantee 
an  adequate  closed-loop  performance.  Model-based 
control  approaches  allow  a  transparent  reconfigura¬ 
tion  of  the  control  algorithm  on  the  basis  of  the 
identified  patient’s  parameters.  Consequently,  they 
emerge  as  the  ideal  control  strategy  for  biomedical 
systems. 
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